An Asynchronous Parallel Approach to Sparse Recovery

Asynchronous parallel computing and sparse recovery are two areas that have received recent interest. Asynchronous algorithms are often studied to solve optimization problems where the cost function takes the form $\sum_{i=1}^M f_i(x)$, with a common assumption that each $f_i$ is sparse; that is, each $f_i$ acts only on a small number of components of $x\in\mathbb{R}^n$. Sparse recovery problems, such as compressed sensing, can be formulated as optimization problems, however, the cost functions $f_i$ are dense with respect to the components of $x$, and instead the signal $x$ is assumed to be sparse, meaning that it has only $s$ non-zeros where $s\ll n$. Here we address how one may use an asynchronous parallel architecture when the cost functions $f_i$ are not sparse in $x$, but rather the signal $x$ is sparse. We propose an asynchronous parallel approach to sparse recovery via a stochastic greedy algorithm, where multiple processors asynchronously update a vector in shared memory containing information on the estimated signal support. We include numerical simulations that illustrate the potential benefits of our proposed asynchronous method.Comment: 5 pages, 2 figure

Linear Convergence of Stochastic Iterative Greedy Algorithms with Sparse Constraints

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to the solution within a specified tolerance. This generalized framework applies to problems such as sparse signal recovery in compressed sensing, low-rank matrix recovery, and co-variance matrix estimation, giving methods with provable convergence guarantees that often outperform their deterministic counterparts. We also analyze the settings where gradients and projections can only be computed approximately, and prove the methods are robust to these approximations. We include many numerical experiments which align with the theoretical analysis and demonstrate these improvements in several different settings

Weighted ℓ1-Minimization for Sparse Recovery under Arbitrary Prior Information

Weighted ℓ1-minimization has been studied as a technique for the reconstruction of a sparse signal from compressively sampled measurements when prior information about the signal, in the form of a support estimate, is available. In this work, we study the recovery conditions and the associated recovery guarantees of weighted ℓ1-minimization when arbitrarily many distinct weights are permitted. For example, such a setup might be used when one has multiple estimates for the support of a signal, and these estimates have varying degrees of accuracy. Our analysis yields an extension to existing works that assume only a single constant weight is used. We include numerical experiments, with both synthetic signals and real video data, that demonstrate the benefits of allowing non-uniform weights in the reconstruction procedure

Constrained Adaptive Sensing

Suppose that we wish to estimate a vector x∈Cn from a small number of noisy linear measurements of the form y=Ax+z, where z represents measurement noise. When the vector x is sparse, meaning that it has only s nonzeros with s≪n, one can obtain a significantly more accurate estimate of x by adaptively selecting the rows of A based on the previous measurements provided that the signal-to-noise ratio (SNR) is sufficiently large. In this paper we consider the case where we wish to realize the potential of adaptivity but where the rows of A are subject to physical constraints. In particular, we examine the case where the rows of A are constrained to belong to a finite set of allowable measurement vectors. We demonstrate both the limitations and advantages of adaptive sensing in this constrained setting. We prove that for certain measurement ensembles, the benefits offered by adaptive designs fall far short of the improvements that are possible in the unconstrained adaptive setting. On the other hand, we also provide both theoretical and empirical evidence that in some scenarios adaptivity does still result in substantial improvements even in the constrained setting. To illustrate these potential gains, we propose practical algorithms for constrained adaptive sensing by exploiting connections to the theory of optimal experimental design and show that these algorithms exhibit promising performance in some representative applications

Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017.

The Global Burden of Diseases, Injuries and Risk Factors 2017 includes a comprehensive assessment of incidence, prevalence, and years lived with disability (YLDs) for 354 causes in 195 countries and territories from 1990 to 2017. Previous GBD studies have shown how the decline of mortality rates from 1990 to 2016 has led to an increase in life expectancy, an ageing global population, and an expansion of the non-fatal burden of disease and injury. These studies have also shown how a substantial portion of the world's population experiences non-fatal health loss with considerable heterogeneity among different causes, locations, ages, and sexes. Ongoing objectives of the GBD study include increasing the level of estimation detail, improving analytical strategies, and increasing the amount of high-quality data. METHODS: We estimated incidence and prevalence for 354 diseases and injuries and 3484 sequelae. We used an updated and extensive body of literature studies, survey data, surveillance data, inpatient admission records, outpatient visit records, and health insurance claims, and additionally used results from cause of death models to inform estimates using a total of 68 781 data sources. Newly available clinical data from India, Iran, Japan, Jordan, Nepal, China, Brazil, Norway, and Italy were incorporated, as well as updated claims data from the USA and new claims data from Taiwan (province of China) and Singapore. We used DisMod-MR 2.1, a Bayesian meta-regression tool, as the main method of estimation, ensuring consistency between rates of incidence, prevalence, remission, and cause of death for each condition. YLDs were estimated as the product of a prevalence estimate and a disability weight for health states of each mutually exclusive sequela, adjusted for comorbidity. We updated the Socio-demographic Index (SDI), a summary development indicator of income per capita, years of schooling, and total fertility rate. Additionally, we calculated differences between male and female YLDs to identify divergent trends across sexes. GBD 2017 complies with the Guidelines for Accurate and Transparent Health Estimates Reporting

Global, regional, and national disability-adjusted life-years (DALYs) for 359 diseases and injuries and healthy life expectancy (HALE) for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017.

How long one lives, how many years of life are spent in good and poor health, and how the population's state of health and leading causes of disability change over time all have implications for policy, planning, and provision of services. We comparatively assessed the patterns and trends of healthy life expectancy (HALE), which quantifies the number of years of life expected to be lived in good health, and the complementary measure of disability-adjusted life-years (DALYs), a composite measure of disease burden capturing both premature mortality and prevalence and severity of ill health, for 359 diseases and injuries for 195 countries and territories over the past 28 years. Methods We used data for age-specific mortality rates, years of life lost (YLLs) due to premature mortality, and years lived with disability (YLDs) from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2017 to calculate HALE and DALYs from 1990 to 2017. We calculated HALE using age-specific mortality rates and YLDs per capita for each location, age, sex, and year. We calculated DALYs for 359 causes as the sum of YLLs and YLDs. We assessed how observed HALE and DALYs differed by country and sex from expected trends based on Socio-demographic Index (SDI). We also analysed HALE by decomposing years of life gained into years spent in good health and in poor health, between 1990 and 2017, and extra years lived by females compared with males. Findings Globally, from 1990 to 2017, life expectancy at birth increased by 7·4 years (95% uncertainty interval 7·1-7·8), from 65·6 years (65·3-65·8) in 1990 to 73·0 years (72·7-73·3) in 2017. The increase in years of life varied from 5·1 years (5·0-5·3) in high SDI countries to 12·0 years (11·3-12·8) in low SDI countries. Of the additional years of life expected at birth, 26·3% (20·1-33·1) were expected to be spent in poor health in high SDI countries compared with 11·7% (8·8-15·1) in low-middle SDI countries. HALE at birth increased by 6·3 years (5·9-6·7), from 57·0 years (54·6-59·1) in 1990 to 63·3 years (60·5-65·7) in 2017. The increase varied from 3·8 years (3·4-4·1) in high SDI countries to 10·5 years (9·8-11·2) in low SDI countries. Even larger variations in HALE than these were observed between countries, ranging from 1·0 year (0·4-1·7) in Saint Vincent and the Grenadines (62·4 years [59·9-64·7] in 1990 to 63·5 years [60·9-65·8] in 2017) to 23·7 years (21·9-25·6) in Eritrea (30·7 years [28·9-32·2] in 1990 to 54·4 years [51·5-57·1] in 2017). In most countries, the increase in HALE was smaller than the increase in overall life expectancy, indicating more years lived in poor health. In 180 of 195 countries and territories, females were expected to live longer than males in 2017, with extra years lived varying from 1·4 years (0·6-2·3) in Algeria to 11·9 years (10·9-12·9) in Ukraine. Of the extra years gained, the proportion spent in poor health varied largely across countries, with less than 20% of additional years spent in poor health in Bosnia and Herzegovina, Burundi, and Slovakia, whereas in Bahrain all the extra years were spent in poor health. In 2017, the highest estimate of HALE at birth was in Singapore for both females (75·8 years [72·4-78·7]) and males (72·6 years [69·8-75·0]) and the lowest estimates were in Central African Republic (47·0 years [43·7-50·2] for females and 42·8 years [40·1-45·6] for males). Globally, in 2017, the five leading causes of DALYs were neonatal disorders, ischaemic heart disease, stroke, lower respiratory infections, and chronic obstructive pulmonary disease. Between 1990 and 2017, age-standardised DALY rates decreased by 41·3% (38·8-43·5) for communicable diseases and by 49·8% (47·9-51·6) for neonatal disorders. For non-communicable diseases, global DALYs increased by 40·1% (36·8-43·0), although age-standardised DALY rates decreased by 18·1% (16·0-20·2)

Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017

The Global Burden of Diseases, Injuries, and Risk Factors Study 2017 (GBD 2017) includes a comprehensive assessment of incidence, prevalence, and years lived with disability (YLDs) for 354 causes in 195 countries and territories from 1990 to 2017. Previous GBD studies have shown how the decline of mortality rates from 1990 to 2016 has led to an increase in life expectancy, an ageing global population, and an expansion of the non-fatal burden of disease and injury. These studies have also shown how a substantial portion of the world's population experiences non-fatal health loss with considerable heterogeneity among different causes, locations, ages, and sexes. Ongoing objectives of the GBD study include increasing the level of estimation detail, improving analytical strategies, and increasing the amount of high-quality data.; We estimated incidence and prevalence for 354 diseases and injuries and 3484 sequelae. We used an updated and extensive body of literature studies, survey data, surveillance data, inpatient admission records, outpatient visit records, and health insurance claims, and additionally used results from cause of death models to inform estimates using a total of 68 781 data sources. Newly available clinical data from India, Iran, Japan, Jordan, Nepal, China, Brazil, Norway, and Italy were incorporated, as well as updated claims data from the USA and new claims data from Taiwan (province of China) and Singapore. We used DisMod-MR 2.1, a Bayesian meta-regression tool, as the main method of estimation, ensuring consistency between rates of incidence, prevalence, remission, and cause of death for each condition. YLDs were estimated as the product of a prevalence estimate and a disability weight for health states of each mutually exclusive sequela, adjusted for comorbidity. We updated the Socio-demographic Index (SDI), a summary development indicator of income per capita, years of schooling, and total fertility rate. Additionally, we calculated differences between male and female YLDs to identify divergent trends across sexes. GBD 2017 complies with the Guidelines for Accurate and Transparent Health Estimates Reporting. Globally, for females, the causes with the greatest age-standardised prevalence were oral disorders, headache disorders, and haemoglobinopathies and haemolytic anaemias in both 1990 and 2017. For males, the causes with the greatest age-standardised prevalence were oral disorders, headache disorders, and tuberculosis including latent tuberculosis infection in both 1990 and 2017. In terms of YLDs, low back pain, headache disorders, and dietary iron deficiency were the leading Level 3 causes of YLD counts in 1990, whereas low back pain, headache disorders, and depressive disorders were the leading causes in 2017 for both sexes combined. All-cause age-standardised YLD rates decreased by 3·9% (95% uncertainty interval [UI] 3·1-4·6) from 1990 to 2017; however, the all-age YLD rate increased by 7·2% (6·0-8·4) while the total sum of global YLDs increased from 562 million (421-723) to 853 million (642-1100). The increases for males and females were similar, with increases in all-age YLD rates of 7·9% (6·6-9·2) for males and 6·5% (5·4-7·7) for females. We found significant differences between males and females in terms of age-standardised prevalence estimates for multiple causes. The causes with the greatest relative differences between sexes in 2017 included substance use disorders (3018 cases [95% UI 2782-3252] per 100 000 in males vs s1400 [1279-1524] per 100 000 in females), transport injuries (3322 [3082-3583] vs 2336 [2154-2535]), and self-harm and interpersonal violence (3265 [2943-3630] vs 5643 [5057-6302]). Global all-cause age-standardised YLD rates have improved only slightly over a period spanning nearly three decades. However, the magnitude of the non-fatal disease burden has expanded globally, with increasing numbers of people who have a wide spectrum of conditions. A subset of conditions has remained globally pervasive since 1990, whereas other conditions have displayed more dynamic trends, with different ages, sexes, and geographies across the globe experiencing varying burdens and trends of health loss. This study emphasises how global improvements in premature mortality for select conditions have led to older populations with complex and potentially expensive diseases, yet also highlights global achievements in certain domains of disease and injury

Global, regional, and national disability-adjusted life-years (DALYs) for 359 diseases and injuries and healthy life expectancy (HALE) for 195 countries and territories, 1990-2017: a systematic analysis for the Global Burden of Disease Study 2017

How long one lives, how many years of life are spent in good and poor health, and how the population's state of health and leading causes of disability change over time all have implications for policy, planning, and provision of services. We comparatively assessed the patterns and trends of healthy life expectancy (HALE), which quantifies the number of years of life expected to be lived in good health, and the complementary measure of disability-adjusted life-years (DALYs), a composite measure of disease burden capturing both premature mortality and prevalence and severity of ill health, for 359 diseases and injuries for 195 countries and territories over the past 28 years.; We used data for age-specific mortality rates, years of life lost (YLLs) due to premature mortality, and years lived with disability (YLDs) from the Global Burden of Diseases, Injuries, and Risk Factors Study (GBD) 2017 to calculate HALE and DALYs from 1990 to 2017. We calculated HALE using age-specific mortality rates and YLDs per capita for each location, age, sex, and year. We calculated DALYs for 359 causes as the sum of YLLs and YLDs. We assessed how observed HALE and DALYs differed by country and sex from expected trends based on Socio-demographic Index (SDI). We also analysed HALE by decomposing years of life gained into years spent in good health and in poor health, between 1990 and 2017, and extra years lived by females compared with males. Globally, from 1990 to 2017, life expectancy at birth increased by 7·4 years (95% uncertainty interval 7·1-7·8), from 65·6 years (65·3-65·8) in 1990 to 73·0 years (72·7-73·3) in 2017. The increase in years of life varied from 5·1 years (5·0-5·3) in high SDI countries to 12·0 years (11·3-12·8) in low SDI countries. Of the additional years of life expected at birth, 26·3% (20·1-33·1) were expected to be spent in poor health in high SDI countries compared with 11·7% (8·8-15·1) in low-middle SDI countries. HALE at birth increased by 6·3 years (5·9-6·7), from 57·0 years (54·6-59·1) in 1990 to 63·3 years (60·5-65·7) in 2017. The increase varied from 3·8 years (3·4-4·1) in high SDI countries to 10·5 years (9·8-11·2) in low SDI countries. Even larger variations in HALE than these were observed between countries, ranging from 1·0 year (0·4-1·7) in Saint Vincent and the Grenadines (62·4 years [59·9-64·7] in 1990 to 63·5 years [60·9-65·8] in 2017) to 23·7 years (21·9-25·6) in Eritrea (30·7 years [28·9-32·2] in 1990 to 54·4 years [51·5-57·1] in 2017). In most countries, the increase in HALE was smaller than the increase in overall life expectancy, indicating more years lived in poor health. In 180 of 195 countries and territories, females were expected to live longer than males in 2017, with extra years lived varying from 1·4 years (0·6-2·3) in Algeria to 11·9 years (10·9-12·9) in Ukraine. Of the extra years gained, the proportion spent in poor health varied largely across countries, with less than 20% of additional years spent in poor health in Bosnia and Herzegovina, Burundi, and Slovakia, whereas in Bahrain all the extra years were spent in poor health. In 2017, the highest estimate of HALE at birth was in Singapore for both females (75·8 years [72·4-78·7]) and males (72·6 years [69·8-75·0]) and the lowest estimates were in Central African Republic (47·0 years [43·7-50·2] for females and 42·8 years [40·1-45·6] for males). Globally, in 2017, the five leading causes of DALYs were neonatal disorders, ischaemic heart disease, stroke, lower respiratory infections, and chronic obstructive pulmonary disease. Between 1990 and 2017, age-standardised DALY rates decreased by 41·3% (38·8-43·5) for communicable diseases and by 49·8% (47·9-51·6) for neonatal disorders. For non-communicable diseases, global DALYs increased by 40·1% (36·8-43·0), although age-standardised DALY rates decreased by 18·1% (16·0-20·2). With increasing life expectancy in most countries, the question of whether the additional years of life gained are spent in good health or poor health has been increasingly relevant because of the potential policy implications, such as health-care provisions and extending retirement ages. In some locations, a large proportion of those additional years are spent in poor health. Large inequalities in HALE and disease burden exist across countries in different SDI quintiles and between sexes. The burden of disabling conditions has serious implications for health system planning and health-related expenditures. Despite the progress made in reducing the burden of communicable diseases and neonatal disorders in low SDI countries, the speed of this progress could be increased by scaling up proven interventions. The global trends among non-communicable diseases indicate that more effort is needed to maximise HALE, such as risk prevention and attention to upstream determinants of health